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Providing Different QOS to Layer-3 Datagrams 
When Transported on Tunnels 

Background of the Invention 

Field of the Invention 

5 The present invention relates to communication networks, and more specifically to a 

method and apparatus for providing different quality of services (QOS) to layer-3 (e.g., Internet 
Protocol) datagrams when transported on tunnels. 

□Related Art 

H Tunnels are often provided between a pair of network devices at the edge of 

10 fa communication networks. In general, tunnels enable the number of virtual circuits to be 
" J minimized between the two network devices, thereby minimizing the overhead (e.g., routing 
l: S table entries, buffers, etc.) on the two network devices and any other network devices in the path 
of the tunnel. In addition, in case of at least Internet Protocol based communication networks, 
H some of the devices can be assigned non-unique global (i.e., private) IP addresses, and yet enable 
15 communication with many systems using the communication network, as is well known in the 
relevant arts. 

Once provided, a tunnel enables datagrams to be transported from one edge of a 
communication network to the other by encapsulating the datagrams according to a tunneling 
protocol. L2TP and L2F are two common tunneling protocols well known in the relevant arts. 
20 L2TP is described in a document entitled Request for Comment 266 1 (RFC 2661) available from 
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www.ietf.org. and the document is incorporated into the present application in its entirety. 



A network device receives layer-3 (e.g., Internet Protocol) datagrams from an end system, 
and sends the data in the datagrams to a peer network device on the other end of a tunnel. The 
peer network device then sends the data to another end system, and the data transfer may be used 
to implement network applications between the two end systems. 

Network applications often require different services (e.g., latency, bandwidth, reliability 
3of transport, etc.). For example, a real time application (e.g., video-conferencing) may need low 
latency transport while a batch application (e.g., file transfer) may need large bandwidth even 
jif the latency is high. 

~ In addition, datagrams within an application may require different types of services. For 

jexample, an application may be supported by a control flow and it may be desirable to provide 
reliable and quick transport to the related datagrams. The different services (either desired or 
provided) while transporting the data are generally referred to as quality of services (QOS). 

The QOS desired for each datagram may be specified within the header portion of the 
datagram. For example, in the case of Internet Protocol (IP), the desired QOS for a datagram are 
specified by the precedence/type of service (TOS) bits as described in RFC 791, which is 
incorporated in its entirety into the present application herewith. 
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It may be desirable to provide the desired QOS to datagrams even when transported on 
tunnels. For example, a service provider providing a communication network may wish to 
provide differentiated services on a per-datagram basis and charge the end users (using end 
systems) according to the desired or offered QOS. The datagrams may be transported on tunnels, 
5 for example, to minimize the resource overhead on the network devices in the communication 
network. 



Therefore, what is needed is a method and apparatus which enables different desired QOS 
ilto be provided to different datagrams when transported on tunnels. 

IJ Summary of the Invention 

1 A network device provided in accordance with the present invention provides different 

0 quality of services to different layer-3 datagrams transported on tunnels. In an embodiment, a 
O tunnel is provisioned between the network device and a peer network device, with the tunnel 

being implemented to provide different QOS to different packets depending on a packet header 

for the corresponding packet. 



The network device receives a layer-3 datagram and examines the datagram header to 
determine a QOS to be provided to the layer-3 datagram. The network device may first 
encapsulate the data in the datagram for transporting on the tunnel. The encapsulated data in 
turn may be encapsulated in the form of packets. Each packet may contain a packet header to 
provide the QOS determined by examining the header. The network device then sends the 
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packets to the peer network device on the tunnel. As the packets are encapsulated based on the 
QOS determined based on the datagram header, each datagram may receive a desired QOS (as 
indicated by the datagram header). 

According to another aspect of the present invention, a service provider may configure 
5 the network device to provide different QOS to datagrams received on only desired point-to- 
point sessions. The packets received only on the desired sessions are provided different QOS. 
Thus, different end user applications sharing the same point-to-point session may receive 
"differentiated QOS. Accordingly, a service provider may charge different end users differently 
--depending on the offered services. 

10 In one embodiment, a tunnel is provisioned on a virtual circuit (VC) bundle containing 

=- -multiple VCs. Each VC may be provisioned to provide different QOS. Thus, the packets 
- -transporting a datagram may be assigned to one of the VCs depending on the QOS to be 

provided to the datagram. Accordingly, each datagram may receive the QOS provided by the 

corresponding assigned VC. 

15 In an alternative embodiment, a tunnel is provisioned using UDP/IP protocol based 

transport backbone. In the case the layer-3 corresponding IP (Internet Protocol), the TOS (type 
of service)/precedence bits of the IP datagram may be copied into the same field of the UDP/IP 
packet supporting the tunnel. Accordingly, the IP datagrams may receive the QOS specified by 
the TOS/precedence bits indicated by the datagram header. 

Patent Page 5 of 28 CSCO-004/95507 



Further features and advantages of the invention, as well as the structure and operation 
of various embodiments of the invention, are described in detail below with reference to the 
accompanying drawings. In the drawings, like reference numbers generally indicate identical, 
functionally similar, and/or structurally similar elements. The drawing in which an element first 
5 appears is indicated by the leftmost digit(s) in the corresponding reference number. 



Brief Description of the Drawing s 

The present invention will be described with reference to the accompanying drawings, 
jwherein: 

Figure 1 is a block diagram illustrating an example communication environment in which 
10 the present invention can be implemented; 

Figure 2 is a flow chart illustrating a method in accordance with the present invention; 

Figure 3 is a block diagram illustrating the internals of a network access server (NAS) 
-in an embodiment of the present invention; and 

Figure 4 is a block diagram illustrating the implementation of NAS substantially in 
15 software. 



Detailed Description of the Preferred Embodiments 
1. Overview and Discussion of the Invention 

A network device in accordance with the present invention provides specific quality of 
service (QOS) desired for each layer-3 datagram while transporting the datagrams on tunnels. 
20 A tunnel may be set up to provide different QOS and the desired QOS for each datagram may 
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be determined by examining the header of the corresponding datagram. The data in each 
datagram may be transported on a tunnel with a QOS which at least is a closest match of the 
desired QOS. 

The invention is described below with reference to an example environment for 
5 illustration. It should be understood that numerous specific details, relationships, and methods 
are set forth to provide a full understanding of the invention. One skilled in the relevant art, 
however, will readily recognize that the invention can be practiced without one or more of the 
■3 specific details, or with other methods, etc. In other instances, well-known structures or 
f iJ operations are not shown in detail to avoid obscuring the invention. Furthermore the invention 
10 Hcan be implemented in several other environments. 

\ :;;2. Example Environment 

] 4 Figure 1 is a block diagram illustrating an example communication environment 100 in 

which the present invention can be implemented. Communication environment 100 is shown 
containing remote systems 1 10- A through 1 10-X, access network 120, network access server 
15 (NAS) 150, home gateways 170-Aand 170-B, andhosts 190-Aand 190-B. Access network 120, 
NAS 150 and home gateways 170-A and 170-B may be together referred to as a communication 
network providing connectivity between remote systems and target hosts. Each component is 
described below in further detail. 



Remote systems 1 10-A through 1 10-X are used by subscribers (or end users) to access 
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hosts of interest. Devices commonly knows as customer premise equipment (CPE) and computer 
systems with modems are examples of remote systems 110- A through 110-X. Each remote 
system 1 1 0-A through 1 1 0-X may access a desired host 1 90- A or 1 90-B. Remote systems 1 1 0-A 
through 1 10-X send and receive datagrams consistent with layer-3 protocols according to pre- 
determined conventions. The data in the datagrams serves as a basis for supporting several user 
applications between hosts 190-A and 190-B, and remote systems 1 10-A through 110-X. 

Access network 120 provides the electrical and physical interface consistent with the 
[technology (e.g., remote access, Digital Subscriber Line) used by the corresponding remote 
1 system. Access network 1 20 may transport layer-3 datagrams between remote systems andNAS 
! 1 50. In an embodiment, access network 120 enables a point to point session to be set up between 
= each remote system and the respective home gateway 170-A or 170-B. Backbone path 157-A 
S may contain several intermediate devices (not shown) and can be implemented in a known way. 

Network access server (NAS) 150 and home gateways 170-A and 170-B (aggregation 
devices in general) may be configured to support tunnels on the side of path 1 5 7- A, and layer-3 
protocols on the other side. NAS 150 may convert layer-3 datagrams into packets (e.g., ATM 
cells, IP datagrams, and Frame Relay frames) suitable for sending on the earlier provisioned 
tunnels. The tunnels may be provided with the ability to provide different QOS to different 
packets. The manner in which the aggregation devices may provide differentiated services to 
different datagrams is described below in further detail. 
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3. Method 

Figure 2 is a flow chart depicting a method in accordance with the present invention. The 
method is described with reference to Figure 1 for illustration. However, the method may be 
performed in other environments as well. The method starts in step 201, in which control 
immediately passes to step 210. 

In step 2 1 0, a tunnel is provisioned with the ability to provide different QOS to different 
packets transported. Some example approaches of provisioning tunnels providing different QOS 
are described below with reference to NAS 150 in further detail. 

In step 220, NAS 150 may receive a datagram from remote system 1 10-A. In step 250, 
""NAS 150 may examine the datagram header to determine the QOS to be provided for 
S transporting the data in the received datagram. 

In step 270, the data in the datagram is encapsulated to in packets, with the packet header 
being set to provide the determined QOS. The packets contain the tunnel information in 
addition. The packet header is determined by the specific protocol implemented on backbone 
path 157-A. In an example embodiment described below, the tunnels are described as being 
implemented within UDP/IP protocol stack. 



In step 290, the packets are transmitted on backbone path 157-A. As the packet(s) is (are) 
encapsulated to provide the determined QOS, the datagram received in step 220 is provided the 

Patent Page 9 of 28 CSCO-004/95507 



determined QOS when transferred on backbone path 157-A. An embodiment of NAS 150 is 
described below in further detail. 

4. Network access server (NAS) 

Figure 3 is a block diagram illustrating the internals of NAS 1 50 in an embodiment of the 
present invention. The embodiment is described in the context of datagrams received on point- 
to-point sessions (set up between remote system 110- A and home gateway 170) and L2TP 
tunnels implemented using VC bundles (set up between NAS 150 and home gateway 170) 
J containing multiple ATM virtual circuits on backbone 157-A. 

In general, a VC bundle contains multiple virtual circuits to the same destination network 
'device and network devices (including NAS 150 and home gateway 170- A) may need to 
; maintain a single forwarding (routing) entry for each VC bundle, thereby minimizing the 
U overhead on the network devices. Alternatively, a VC bundle may contain multiple independent 
virtual circuits which are provisioned between the two end points of the corresponding tunnel 
sought to be implemented. 

Only the details of the technologies as relevant to an understanding of various aspects of 
the present invention are described in the present application. The reader is referred to the 
following public documents for further details on the corresponding technology, and all the 
documents are incorporated in their entirety into the present application: 

ATM: Book entitled, "ATM: Theory and Application", ISBN Number: 0-07-060362-6, 
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by David E. McDysan and Darren L. Spohn; 
Point-to-point session: RPC 1661, available from www.ietf.org; 
Internet Protocol: RFC 791, available from www.ietf.org; and 
Tunnels: RFC 2661, available from www.ietf.org. 

Continuing with reference to Figure 3 , NAS 1 5 0 is shown containing input interface 310, 
classifier 320, marker 340, tunnel encapsulator 350, forwarding block 360, tables 366, and output 
interface 370. Each component is described below in further detail. 

\ Each component of network aggregation server 150 may be implemented in a 

8 combination of one or more of hardware, software and firmware. In general, when throughput 
""performance is of primary consideration, the implementation is performed more in hardware 
;(e.g., in the form of an application specific integrated circuit). When cost is of primary 
y consideration, the implementation is performed more in software (e.g., using a processor 
executing instructions provided in software/firmware). Cost and performance can be balanced 
by implementing network aggregation server 150 with a desired mix of hardware, software 
and/or firmware. 

Input interface 3 1 0 receives layer-3 datagrams (e.g., Internet Protocol) on a point-to-point 
session ("PPP session") implemented on path 125 and forwards the datagram and PPP session 
information to classifier 320. In general, input interface 310 provides the electrical and other 
physical protocol interfaces on path 125, and may be implemented in a known way. 
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Classifier 320 examines the received datagram to determine the specific session to which 
the datagram relates to. Classifier 320 may then determine whether to provide per-datagram 
QOS to the session by examining an entry in table 366 corresponding to the session. Assuming 
the received datagram is to be provided per-datagram QOS, the datagram is passed to marker 
5 340. 

Marker 340 determines the specific QOS to be provided to the received datagram, and 
marks (i.e., associates) the QOS with the datagram. In the case of IP datagrams, marker 340 may 
% merely use the TOS/precedence bits of the IP header as representing the desired QOS. In an 
:" _ embodiment, if the TOS/precedence bits are determined not have been set, marker 340 may mark 
10 !'1 the datagram with a default value specified in table 366. Alternatively, in the case of IP 
= datagrams, the datagram can be marked with the same value as in the TOS/precedence field. 

\>t Tunnel encapsulator 350 encapsulates the data in the datagram according to a tunneling 

protocol. The tunnel is set up between NAS 150 and home gateway 1 70 in a known way. In an 
embodiment, tunnel encapsulator 350 is implemented consistent with RFC 2661 noted above. 

15 Table 366 may be configured manually (e.g., using a network management station, not 

shown) and/or automatically (e.g., virtual circuits using a suitable signaling protocol). Table 366 
may specify the specific point-to-point sessions to which per-datagram QOS is to be provided 
in accordance with the present invention. For some of the point-to-point session, table 366 may 
specify default QOS to be provided. 
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In addition, table 366 may contain protocol encapsulation information to provide each 
type of QOS provided by NAS 150. In one embodiment, a tunnel between NAS 150 and home 
gateway 1 70-A is implemented using multiple ATM virtual circuits forming a VC bundle, with 
each virtual circuit providing a different (set of) QOS. Thus, table 366 may be configured to 
indicate the specific virtual circuit (e.g., by a virtual circuit identifier) to be used for each QOS. 
Table may be implemented using a memory. A non-volatile memory (potentially provided 
external to NAS 150) may be used to store the data permanently, and the data may be loaded into 
a random access memory (RAM) during the operation of NAS 150 for a superior performance. 

Forwarding block 360 receives encapsulated data of each datagram from tunnel 
J encapsulator 350, and encapsulates the data in the form of one or more packets. The packet 
header may be determined according to the data in table 366. In the case of tunnels implemented 
? on a VC bundle as noted above, forwarding block 360 may retrieve from table 366 a virtual 
| circuit identifier (VCI/VPI) corresponding to the mark received from marker 340, and 
encapsulates the data (received from tunnel encapsulator 3 5 0) in packets using the virtual circuit 
identifier in the header. 

Output interface 370 receives the packets from forwarding block 360, and transmits the 
received packets on backbone 15 7- A. Output interface 370 provides the electrical and other 
physical protocol interfaces with backbone 157-A, and may be implemented in a known way. 



Home gateway 170-A receives the packets (e.g., ATM cells in AAL5 format) on the 
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different virtual circuits and supports the point-to-point sessions. Home gateway 170-A may be 
implemented in a known way. Thus, NAS 150 may be implemented to provide different QOS 
to different datagrams. 

While the above description is provided with respect to tunnels implemented using VC 
bundles on ATM backbones, it should be appreciated that alternative embodiments may be 
implemented using other technologies. For example, tunnels may be implemented using UDP/IP 
transport, and in such a case marker 340 may merely provide the bits in TOS/precedence bits to 

3 forwarding block 360. In turn, forwarding block 360 may copy the received bits into the 

-2 TOS/precedence fields of the outer UDP/IP encapsulation. 

Accordingly, each packet (or datagram) in the UDP/IP tunnel may have the same 
\ TOS/precedence bits of the transported packet. As the UDP/IP packet in the tunnel may be 
I provided the QOS corresponding to the TOS/precedence bits, the transported datagram may 
receive desired QOS. Also, as noted above, the components of NAS 150 may be implemented 
in the form of software also. An example software implementation is described below in further 
detail. 

5. Software Implementation 

Figure 4 is a block diagram illustrating the details of a network device (e.g., NAS 150) 
in one embodiment. NAS 1 50 is shown containing processing unit 410, random access memory 
(RAM) 420, storage 430, output interface 460, network interface 480 and input interface 490. 
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Each component is described in further detail below. 

Output interface 460 provides output signals (e.g., display signals to a display unit, not 
shown) which can form the basis for a suitable user interface for a user to interact withNAS 150. 
Input interface 490 (e.g., interface with a key-board and/or mouse, not shown) enables a user to 
provide any necessary inputs to NAS 150. Output interface 460 and input interface 490 can be 
used, for example, to enable configuration of NAS 1 50 to provide various features of the present 
invention. 

Network interface 480 enables NAS 1 50 to send and receive data on communication 
jnetworks using protocols as asynchronous transfer mode (ATM). Network interface 480 may 
correspond to input interface 310 and output interface 390 of Figure 3. Network interface 480, 
^output interface 460 and input interface 490 can be implemented in a known way. 

RAM 420 and storage 430 may together be referred to as a memory. RAM 430 may 
receive instructions and data on path 450 from storage 430. Secondary memory 430 may contain 
units such as hard drive 435 and removable storage drive 437. Secondary storage 430 may store 
the software instructions and data, which enable NAS 450 to provide several features in 
accordance with the present invention. 



Some or all of the data and instructions may be provided on removable storage unit 440, 
and the data and instructions may be read and provided by removable storage drive 437 to 
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processing unit 410. Floppy drive, magnetic tape drive, CD-ROM drive, DVD Drive, Flash 
memory, removable memory chip (PCMCIA Card, EPROM) are examples of such removable 
storage drive 437. 

Processing unit 410 may contain one or more processors. Some of the processors can be 
5 general purpose processors which execute instructions provided from RAM 420. Some can be 
special purpose processors adapted for specific tasks (e.g., for memory/queue management). The 
special purpose processors may also be provided instructions from RAM 420. In general, 
processing unit 410 reads sequences of instructions from various types of memory medium 
" " (including RAM 420, storage 430 and removable storage unit 440), and executes the instructions 
10 to provide various features of the present invention. 

Thus, NAS 150 may be implemented substantially in software to provide different QOS 
to different datagrams. Home gateway 170 and other network devices may also be implemented 
similarly to provide differentiated services as will be apparent to one skilled in the relevant arts 
by reading the disclosure provided herein. Such other implementations are also contemplated 
15 to be within the scope and spirit of the present invention. 

Accordingly, a service provider may configure the aggregation devices (NAS 150 and 
home gateway 170-A in the above embodiments) appropriately and provide different QOS to 
different datagrams and charge the end user consistent with offered services. 
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6. Conclusion 

While various embodiments of the present invention have been described above, it should 
be understood that they have been presented by way of example only, and not limitation. Thus, 
the breadth and scope of the present invention should not be limited by any of the above- 
described exemplary embodiments, but should be defined only in accordance with the following 
claims and their equivalents. 
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